A child protection agency in Victoria, Australia, has recently been compelled to issue a ban requiring staff not to use generative AI services. This decision came after an employee entered a large amount of personal information, including the name of a high-risk child, while using ChatGPT to write a protective application report. The incident raised concerns with the Office of the Victorian Information Commissioner (OVIC), which received a report in December last year and subsequently launched an investigation. The outcomes of the investigation revealed that the report submitted by the employee involved a young child.

Students are using artificial intelligence to create images suspected of child sexual abuse, with a shocking level of realism. Experts are calling for urgent action, suggesting schools stop the dissemination of child sexual abuse materials. The quality of the images is comparable to professional children's photographs, and the realistic portrayal of children could be spread across the internet. Child protection organizations recommend the establishment of better systems to prevent such harmful behavior.